Neural network control design for an unmanned aerial vehicle with a suspended payload

Unmanned aerial vehicles (UAVs) demonstrate excellent manoeuvrability in cluttered environments, which makes them a suitable platform as a data collection and parcel delivering system. In this work, the attitude and position control challenges for a drone with a package connected by a wire is analysed. During the delivering task, it is very difficult to eliminate the external unpredictable disturbances. A robust neural network-based backstepping sliding mode control method is designed, which is capable of monitoring the drone's flight path and desired attitude with a suspended cable attached. The convergence of the position and attitude errors together with the Lyapunov function are employed to attest to the robustness of the nonlinear transportation platform. The proposed control system is tested with a simulation and in an outdoor environment. The simulation and open field test results for the UAV transportation platform verify the controllers' reliability

Neural network control design for an unmanned aerial vehicle with a suspended payload

Unmanned aerial vehicles (UAVs) demonstrate excellent manoeuvrability in cluttered environments, which makes them a suitable platform as a data collection and parcel delivering system. In this work, the attitude and position control challenges for a drone with a package connected by a wire is analysed. During the delivering task, it is very difficult to eliminate the external unpredictable disturbances. A robust neural network-based backstepping sliding mode control method is designed, which is capable of monitoring the drone's flight path and desired attitude with a suspended cable attached. The convergence of the position and attitude errors together with the Lyapunov function are employed to attest to the robustness of the nonlinear transportation platform. The proposed control system is tested with a simulation and in an outdoor environment. The simulation and open field test results for the UAV transportation platform verify the controllers' reliability

A neural network based landing method for an unmanned aerial vehicle with soft landing gears

This paper presents the design, implementation, and testing of a soft landing gear together with a neural network-based control method for replicating avian landing behavior on non-flat surfaces. With full consideration of unmanned aerial vehicles and landing gear requirements, a quadrotor helicopter, comprised of one flying unit and one landing assistance unit, is employed. Considering the touchdown speed and posture, a novel design of a soft mechanism for non-flat surfaces is proposed, in order to absorb the remaining landing impact. The framework of the control strategy is designed based on a derived dynamic model. A neural network-based backstepping controller is applied to achieve the desired trajectory. The simulation and outdoor testing results attest to the effectiveness and reliability of the proposed control method

High-precision UWB based localisation for UAV in extremely confined environments

In this paper, a high-precision ultra-wideband (UWB) based unmanned aerial vehicle (UAV) localisation approach is proposed for applications in extremely confined environments. It is motivated by the emerging demand on autonomous inspection in such environments that are hard or impossible for humans to access. Instead of the traditional localisation techniques such as global positioning system (GPS), vision based or other localisation techniques, the UWB based localisation technique is adopted for precise UAV positioning due to its high accuracy, implementation simplicity and suitability in such environments. To avoid the requirement on strict synchronisation between sensor nodes and provide decimetre-level accuracy, the proposed algorithm combined the two-way time-of-flight (TW-TOF) localisation scheme with the maximum likelihood estimation (MLE) method. This differs from applications in other environments, the number and deployment area of anchor nodes are highly restricted in such environments. Therefore, an in-depth investigation for the anchor deployment strategies is presented to find the most suitable geometry configurations with accurate and robust performance. Finally, extensive simulations, static experiments and flight tests have been conducted to validate the localisation performance under different deployment strategies. The experiments show that average localisation error and standard deviation (STD) under 0.2 m and 0.07 m are obtainable by using our proposed approach under three different geometry configurations of anchor nodes. This is suitable for different applications in extremely confined environments

UAV first view landmark localization with active reinforcement learning

We present an active reinforcement learning framework for unmanned aerial vehicle (UAV) first view landmark localization. We formulate the problem of landmark localization as that of a Markov decision process and introduce an active landmark-localization network (ALLNet) to address it. The aim of the ALLNet is to locate a bounding box that surrounds the landmark in a first view image sequence. To this end, it is trained in a reinforcement learning fashion. Specifically, it employs support vector machine (SVM) scores on the bounding box patches as rewards and learns the bounding box transformations as actions. Furthermore, each SVM score indicates whether or not the landmark is detected by the bounding box such that it enables the ALLNet to have the capability of judging whether the landmark leaves or re-enters a first view image. Therefore, the operation of the ALLNet is not only dominated by the reinforcement learning process but also supplemented by an active learning motivated manner. Once the landmark is considered to leave the first view image, the ALLNet stops operating until the SVM detects its re-entry to the view. The active reinforcement learning model enables training a robust ALLNet for landmark localization. The experimental results validate the effectiveness of the proposed model for UAV first view landmark localization

A neural network based landing method for an unmanned aerial vehicle with soft landing gears

This paper presents the design, implementation, and testing of a soft landing gear together with a neural network-based control method for replicating avian landing behavior on non-flat surfaces. With full consideration of unmanned aerial vehicles and landing gear requirements, a quadrotor helicopter, comprised of one flying unit and one landing assistance unit, is employed. Considering the touchdown speed and posture, a novel design of a soft mechanism for non-flat surfaces is proposed, in order to absorb the remaining landing impact. The framework of the control strategy is designed based on a derived dynamic model. A neural network-based backstepping controller is applied to achieve the desired trajectory. The simulation and outdoor testing results attest to the effectiveness and reliability of the proposed control method

Ultrasonic and IMU based high precision UAV localisation for the low cost autonomous inspection in oil and gas pressure vessels

With the increasing demands for unmanned aerial vehicle (UAV) based autonomous inspections in the oil and gas industry, one of the challenging issues for 3D UAV positioning has emerged due to the satellite signal blocking. Considering the existing characteristics of the ultrasonic based technique, such as the low cost, extremely lightweight and high positioning accuracy, it can be promising as the potential solution. Nevertheless, the low position update rate and vulnerable positioning performance to the changing environment still limit its applications on UAV. Therefore, in this article, an ultrasonic and inertial measurement unit (IMU) based localisation algorithm and low cost UAV autonomous inspection system are presented. With the incorporation of the IMU, the position update rate, accuracy and stability of the algorithm can all be significantly improved. This is done by the adaptively estimated noise covariance matrices through the proposed adaptive extended Kalman filter (AEKF) algorithm and the added weighting factors. Followed by, an additional virtual observation process is presented to overcome the unavailability of the observation information for further performance improvement. Finally, extensive numerical results and field tests demonstrate that the proposed algorithm and system can achieve the high update rate, reliable, accurate and precision UAV positioning in oil and gas pressure vessels and are feasible for the UAV autonomous inspection in these environments

AMCD : an accurate deep learning-based metallic corrosion detector for MAV-based real-time visual inspection

Corrosion has been concerned as a serious safety issue for metallic facilities. Visual inspection carried out by an engineer is expensive, subjective and time-consuming. Micro Aerial Vehicles (MAVs) equipped with detection algorithms have the potential to perform safer and much more efficient visual inspection tasks than engineers. Towards corrosion detection algorithms, convolution neural networks (CNNs) have enabled the power for high accuracy metallic corrosion detection. However, these detectors are restricted by MAVs on-board capabilities. In this study, based on You Only Look Once v3-tiny (Yolov3-tiny), an accurate deep learning-based metallic corrosion detector (AMCD) is proposed for MAVs on-board metallic corrosion detection. Specifically, a backbone with depthwise separable convolution (DSConv) layers is designed to realise efficient corrosion detection. The convolutional block attention module (CBAM), three-scale object detection and focal loss are incorporated to improve the detection accuracy. Moreover, the spatial pyramid pooling (SPP) module is improved to fuse local features for further improvement of detection accuracy. A eld inspection image dataset labelled with four types of corrosions (the nubby corrosion, bar corrosion, exfoliation and fastener corrosion) is utilised for training and testing the AMCD. Test results show that the AMCD achieves 84.96% mean average precision (mAP), which outperforms other state-of-the-art detectors. Meanwhile, 20.18 frames per second (FPS) is achieved leveraging NVIDIA Jetson TX2, the most popular MAVs on-board computer, and the model size is only 6.1MB

Adaptive extended Kalman filter based fusion approach for high precision UAV positioning in extremely confined environments

For unmanned aerial vehicle (UAV)-based smart inspection in extremely confined environments, it is impossible for precise UAV positioning with global positioning system, owing to the satellite signal block. Therefore, the ultrawideband (UWB)-based technology has attracted extensive attention under such circumstances. However, due to the unpredictable propagation condition and the time-varying operational environment, the localization performance oscillation caused by the changing measurement noise may lead to the instability of UAV. To mitigate the effects, in this article, a high-precision UAV positioning system which integrates the inertial measurement unit and UWB with the adaptive extended Kalman filter (EKF) is proposed. Compared with the traditional EKF-based approach, the estimated and recorded information from previous processes is exploited to adaptively estimate and further control the estimation of the noise covariance matrices for the performance improvement. Finally, simulations and experiments have been conducted in extremely confined environments. According to the results, the proposed algorithm can significantly improve the position update rate, the median positioning error, the 95 th percentile positioning error, and the average standard deviation into 88 Hz, 0.102 m, 0.192 m, and 0.052 m, which is applicable for applications in focused environments

Stereo vision-based autonomous navigation for oil and gas pressure vessel inspection using a low-cost UAV

It is vital to visually inspect pressure vessels regularly in the oil and gas company to maintain their integrity. Compared with visual inspection conducted by sending engineers and ground vehicles into the pressure vessel, utilising an autonomous Unmanned Aerial Vehicle (UAV) can overcome many limitations including high labour intensity, low efficiency and high risk to human health. This work focuses on enhancing some existing technologies to support low-cost UAV autonomous navigation for visual inspection of oil and gas pressure vessels. The UAV can gain the ability to follow the planned trajectory autonomously to record videos with a stereo camera in the pressure vessel, which is a GPS-denied and low-illumination environment. Particularly, the ORB-SLAM3 is improved by adopting the image contrast enhancement technique to locate the UAV in this challenging scenario. What is more, a vision hybrid Proportional-Proportional-Integral-Derivative (P-PID) position tracking controller is integrated to control the movement of the UAV. The ROS-Gazebo-PX4 simulator is customised deeply to validate the developed stereo vision-based autonomous navigation approach. It is verified that compared with the ORB-SLAM3, the numbers of ORB feature points and effective matching points obtained by the improved ORB-SLAM3 are increased by more than 400% and 600%, respectively. Thereby, the improved ORB-SLAM3 is effective and robust enough for UAV self-localisation, and the developed stereo vision-based autonomous navigation approach can be deployed for pressure vessel visual inspectio